{"text_format":"1","workbook":"xlsx","n_sheets":10,"sheets":["Respondent Info","General","Governance","Rating","Underwriting","Claims","Fraud Detection","Marketing","Loss Prevention","Sheet2"],"not_rendered":{"charts":0,"images":0,"macros":1,"external_links":0,"defined_names":0,"comments":0,"pivot_tables":0},"unopened":[],"bounds":{"document_bytes":16777216,"sheet_cells":100000,"rows_first":2000,"rows_last":500,"rows_between":2000,"halvings":0,"cell_chars":16384,"cell_head_chars":4096},"cells_cut":0,"cells_raw":0,"read":"whole","date_system":"1900"}

{"sheet":"Respondent Info","index":0,"n_rows":9,"n_cols":2,"rows_kept":9,"cut":false,"hidden":false,"merged":[[0,0,0,2]]}
["RESPONDENT INFORMATION"]
["Version 2022.11.15"]
[1,"NAIC Company Code"]
[2,"Company Name"]
[3,"Contact Name"]
[4,"Contact Title"]
[5,"Contact Phone Number"]
[6,"Contact Email Address"]
[7,"Comments:"]

{"sheet":"General","index":1,"n_rows":25,"n_cols":10,"rows_kept":25,"cut":false,"hidden":false,"merged":[[0,0,0,9],[1,0,1,9],[23,0,23,9],[12,1,12,2],[5,7,8,10],[9,7,12,10],[3,3,3,5]]}
["GENERAL QUESTIONS"]
["AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
[]
[1,"Does your company currently use, plan to use, or plan to explore using Artificial Intelligence (AI)/Machine Learning (ML) as defined for this survey, for any of the following areas? Select all that apply.",null,"Note: \"Select all applicable insurer operations. If any operation is selected, also select \"Companywide.\""]
[null,null,"Currently using","< 1 year until use","1 to 3 years until use","> 3 years until use"]
[2,"If yes for question 1, indicate the implementation status or plan for each of the listed areas.",null,null,null,null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
[3,"If one of your selections for question 1 was “Other”, list the “Other” areas:","Anticipated timing of implementation for each \"other\" area:"]
["3A"]
["3B"]
["3C"]
["3D"]
["3E"]
[4,"If you are not using AI/ML in any of the areas identified in question 1, select all areas that apply to the following reasons"]
["4A","Is it because there's no compelling business reason at this time?"]
["4B","Is it because you're waiting for regulatory guidance?"]
["4C","Is it because there's a lack of resources and expertise?"]
["4D","Is it because there's lack of reliable data and associated security risk?"]
["4E","Is it because of reliance on legacy systems requiring IT, data, and technology system upgrades before starting AI/ML initiatives?"]
["4F","Is it because you're waiting on the availability of a third-party vendor product/service?"]
["4G","Is it because of risk not commensurate with current strategy or appetite?"]
[null,null,"Companywide","Rating","Underwriting","Claims","Fraud Detection","Marketing","Loss Prevention","Other"]
["4H","If for other reasons please, list for each area."]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[5,"How many Regression, Static, and pre-2000 Models does your company currently use, plan to use, or plan to explore using (which are excluded from the AI/ML definition for this survey)? This can be an estimate. If you do not use or plan to use any such models for a given area, enter 0 in the corresponding field."]

{"sheet":"Governance","index":2,"n_rows":24,"n_cols":10,"rows_kept":24,"cut":false,"hidden":false,"merged":[[0,0,0,9],[1,0,1,9],[21,0,21,9],[4,1,4,9],[7,6,10,9]]}
["Questions on Governance and Third Parties"]
["AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
[]
[6,"If you are using data, scores and/or AI/ML models aggregated or developed by a third-party, do those contracts include any conditions that would limit disclosure or otherwise limit transparency to regulators reviewing a filing related to Rating? (Yes/No)"]
[7,"If model governance is in place, please select all areas that are documented in your governance program. Refer to the NAIC AI Principles and the FAQ document for a description of each and more information regarding completing this question. PLEASE NOTE:  It is expected for the governance levels and maturity to be commensurate with the maturity level and risk associated with the program."]
["7A","Fairness and Ethics Considerations"]
["7B","Accountability for Data Algorithms' Compliance with Laws as well as Intended and Unintended Impacts"]
["7C","Appropriate Resources and Knowledge Involved to Ensure Compliance with Laws Including those Related to Unfair Discrimination",null,null,null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
["7D","Ensure Transparency With Appropriate Disclosures Including Notice to Consumers Specific to Data Being Used and Methods for Appeal and Recourse Related to Inaccurate Data"]
["7E","AI Systems are Secure, Safe and Robust including Decision Traceability and Security and Privacy Risk Protections"]
[8,"Do you follow some other existing standards or guidance in regard to governance framework? (Yes/No)"]
["8A","If yes, were the existing standards or guidance developed internally, provided by a third-party, or a hybrid of internally developed and third-party components?"]
[9,"If any standards or guidance are provided by a third party, please provide the following:","Companywide","Rating","Underwriting","Claims","Fraud Detection","Marketing","Loss Prevention","Other"]
["9A","Name of Third-Party"]
["9B","Components of the Governance Framework"]
[10,"Select all areas where consumers are provided information regarding the data elements being used? (Do not select the area if not disclosing any information other than what is required by law.)"]
[11,"Select all areas where consumers are provided information regarding the purposes for which data elements are being used? (Do not select the area if not disclosing any information other than what is required by law.)"]
[12,"Outside of processees required because of FCRA, do consumers have an opportunity to challenge or correct their specific data?"]
["12A","If yes, explain process."]
[]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[13,"Does governance differ substantively depending on model type? (Yes/No)"]
["13A","If yes, explain the process."]

{"sheet":"Rating","index":3,"n_rows":84,"n_cols":35,"rows_kept":84,"cut":false,"hidden":false,"merged":[[80,0,80,8],[63,1,63,4],[42,1,42,4],[55,1,55,4],[42,0,43,0],[55,0,56,0],[50,1,50,4],[71,1,71,4],[42,5,43,5],[55,5,56,5],[0,0,0,8],[26,1,26,4],[38,1,38,4],[6,0,7,0],[18,0,19,0],[30,0,31,0],[6,1,6,4],[18,1,18,4],[30,1,30,4],[6,7,21,11],[6,5,7,5],[18,5,19,5],[30,5,31,5],[1,8,4,11],[1,4,4,7]]}
["AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
["Not found","RATING MODEL USES",null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
[]
[null,"Rating Class Determination"]
[1,"Does your company use or are you investigating AI/ML for Rating Class Determination?"]
["1A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[2,"List each AI/ML model used for Rating Class Determination (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply",null,"The AI/ML Model Category Types are shown below. Detailed definitions can be found within the HO AI/ML Definitions:\n•\tDL –   Deep Learning\n•\tENS –   Ensemble\n•\tNN –   Neural Network\n•\tREG –   Regularization\n•\tRS –   Rule System\n•\tRGS – Regression  \n•\tBAY –   Bayesian Methods\n•\tDT –   Decision Trees \n•\tDR –   Dimensionality Reduction\n•\tIB –   Instance-Based \n•\tCLU –   Clustering \n•\tAI – AI that is not categorized as ML\n• AML - Automated Machine Learning\n•\tOther – Any Other"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["2A"]
["2B"]
["2C"]
["2D"]
["2E"]
["2F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Price Optimization"]
[3,"Does your company use or are you investigating AI/ML for Price Optimization?"]
["3A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[4,"List each AI/ML model used for Price Optimization (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["4A"]
["4B"]
["4C"]
["4D"]
["4E"]
["4F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Retention Modeling"]
[5,"Does your company use or are you investigating AI/ML for Retention Modeling?"]
["5A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[6,"List each AI/ML model used for Retention Modeling (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["6A"]
["6B"]
["6C"]
["6D"]
["6E"]
["6F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Numerical Relativity Determination"]
[7,"Does your company use or are you investigating AI/ML for Numerical Relativity Determination?"]
["7A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[8,"List each AI/ML model used for Numerical Relativity Determination (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["8A"]
["8B"]
["8C"]
["8D"]
["8E"]
["8F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Other Rate-Related Functions"]
[9,"Does your company use or are you investigating AI/ML for Other Rate-Related Functions?"]
["9A","If yes, list the other functions:"]
["9B","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[10,"List each AI/ML model used for Other Rate-Related Functions (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["10A"]
["10B"]
["10C"]
["10D"]
["10E"]
["10F","If more than 5 AI/ML models are used, list them here:"]
[]
[]
[]
[null,"RATING DATA ELEMENTS"]
[]
[null,"Data Element Type:","Internal","External","Both"]
[100,"Select all element types your company uses WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense)"]
["100A","If \"Other: Non-Traditional Data Elements\" was selected in Question 100, list those other data elements:"]
[101,"If External OR Both in Question 100, list each data vendor:"]
["101A"]
["101B"]
["101C"]
["101D"]
["101E"]
["101F","If more than 5 AI/ML RATING data vendors are used for the respective data element type, please list additional vendors here: "]
[102,"Does the AI/ML System use as an input any type of Consumer or Other \"Score\" calculated with the data element as a component of the score calculation? "]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[null,"Data Element Type:","Consumer or Other Type of \"Score\"","Criminal Convictions (Exclude Auto-Related Convictions)","Insured Demographic Data (Age, Marital, Status, Size of Family)","Geodemographic Data (Non-insurance statistics by ZIP code, census block, etc.)","Education","Facial Detection/ Recognition/ Analysis","Geocoding","Topography (Land Slope, Elevation, etc.)","Historical Weather Information (Temperature, precipitation, etc.)","Hurricane Model Output (AAL, PML, etc.)","Excess Wind/Hail Model Output (AAL, PML, etc.)","Flood Model Output (AAL, PML, etc.)","Earthquake Model Output (AAL, PML, etc.)","Wildfire Wind/Hail Model Output (AAL, PML, etc.)","Job Stability","Income","Occupation","Personal Financial Information","Insured Claim Experience--Home","Insured Claim Experience--Auto","Industry Territorial Loss Statistics","Territorial Crime Rates","Territorial Tax Rates","Medical","Online Media","Smart Home Devices","Security Systems","Roof Data","Defect Identification in Images (Inherent Risk in the Property)","Hazard Detection in Images (risk due to surrounding area)","Potential Loss Estimates in Images (when writing the policy)","Claims Estimates in Images (when setting reserves or adjusting a claim)           ","Other: Non-Traditional Data Elements (Please provide examples)"]
[103,"Does your company use the following data element type WITHIN REGRESSION, STATIC, OR PRE-2000 MODELS? (Respond Yes or No to each Data Element Type.)",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A"]
[104,"If yes for question 103, estimate the number of these types of models utilizing the data element. ",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A","List examples here"]

{"sheet":"Underwriting","index":4,"n_rows":183,"n_cols":35,"rows_kept":183,"cut":false,"hidden":false,"merged":[[153,5,154,5],[176,1,176,2],[90,5,91,5],[102,5,103,5],[114,5,115,5],[127,5,128,5],[139,5,140,5],[170,1,170,4],[153,1,153,4],[90,1,90,4],[102,1,102,4],[114,1,114,4],[127,1,127,4],[139,1,139,4],[66,5,67,5],[78,5,79,5],[30,0,31,0],[30,1,30,4],[6,7,21,11],[6,5,7,5],[18,5,19,5],[30,5,31,5],[42,5,43,5],[78,1,78,4],[1,4,4,7],[179,0,179,8],[0,0,0,8],[6,0,7,0],[6,1,6,4],[18,0,19,0],[18,1,18,4],[42,0,43,0],[42,1,42,4],[54,1,54,4],[66,0,67,0],[66,1,66,4],[54,0,55,0],[78,0,79,0],[153,0,154,0],[54,5,55,5]]}
["AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
["Not found","UNDERWRITING MODELS",null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
[]
[null,"Automated Approval"]
[1,"Does your company use or are you investigating AI/ML for Automated Approval?"]
["1A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[2,"List each AI/ML model used for Automated Approval (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply",null,"The AI/ML Model Category Types are shown below. Detailed definitions can be found within the HO AI/ML Definitions:\n•\tDL –   Deep Learning\n•\tENS –   Ensemble\n•\tNN –   Neural Network\n•\tREG –   Regularization\n•\tRS –   Rule System\n•\tRGS – Regression  \n•\tBAY –   Bayesian Methods\n•\tDT –   Decision Trees \n•\tDR –   Dimensionality Reduction\n•\tIB –   Instance-Based \n•\tCLU –   Clustering \n•\tAI – AI that is not categorized as ML\n• AML - Automated Machine Learning\n•\tOther – Any Other"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["2A",null,null,null,null,"REG, BAY"]
["2B"]
["2C"]
["2D"]
["2E"]
["2F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Automated Denial"]
[3,"Does your company use or are you investigating AI/ML for Automated Denial?"]
["3A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[4,"List each AI/ML model used for Automated Denial (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["4A"]
["4B"]
["4C"]
["4D"]
["4E"]
["4F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Underwriting Tier Determination"]
[5,"Does your company use or are you investigating AI/ML for Underwriting Tier Determination?"]
["5A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[6,"List each AI/ML model used for Underwriting Tier Determination (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["6A"]
["6B"]
["6C"]
["6D"]
["6E"]
["6F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Company Placement"]
[7,"Does your company use or are you investigating AI/ML for Company Placement?"]
["7A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[8,"List each AI/ML model used for Company Placement (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["8A"]
["8B"]
["8C"]
["8D"]
["8E"]
["8F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Input into Non-Automated Approval Decision"]
[9,"Does your company use or are you investigating AI/ML for Input into Non-Automated Approval Decision?"]
["9A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[10,"List each AI/ML model used for Input into Non-Automated Approval Decision (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["10A"]
["10B"]
["10C"]
["10D"]
["10E"]
["10F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Input into Non-Automated Denial Decision"]
[11,"Does your company use or are you investigating AI/ML for Input into Non-Automated Denial Decision?"]
["11A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[12,"List each AI/ML model used for Input into Non-Automated Denial Decision (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["12A"]
["12B"]
["12C"]
["12D"]
["12E"]
["12F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Automate Processing Thru the Agency Channel"]
[13,"Does your company use or are you investigating AI/ML for Automate Processing Thru the Agency Channel?"]
["13A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[14,"List each AI/ML model used for Automate Processing Thru the Agency Channel (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["14A"]
["14B"]
["14C"]
["14D"]
["14E"]
["14F","If more than 5 AI/ML models are used, list them here:"]
[]
[null,"Renewals and Reinstatements"]
[15,"Does your company use or are you investigating AI/ML for Renewals and Reinstatements?"]
["15A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[16,"List each AI/ML model used for Renewals and Reinstatements (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["16A"]
["16B"]
["16C"]
["16D"]
["16E"]
["16F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Verification of Policy Characteristics"]
[17,"Does your company use or are you investigating AI/ML for Verification of Policy Characteristics?"]
["17A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[18,"List each AI/ML model used for Verification of Policy Characteristics (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["18A"]
["18B"]
["18C"]
["18D"]
["18E"]
["18F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Policy Anomaly Detection"]
[19,"Does your company use or are you investigating AI/ML for Policy Anomaly Detection?"]
["19A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
["19B","List each AI/ML model used for Policy Anomaly Detection (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[20,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["20A"]
["20B"]
["20C"]
["20D"]
["20E"]
["20J","If more than 5 AI/ML models are used, please list them here:"]
[]
[]
[null,"Down-Payment Requirements"]
[21,"Does your company use or are you investigating AI/ML for Down-Payment Requirements?"]
["21A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[22,"List each AI/ML model used for Down-Payment Requirements (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["22A"]
["22B"]
["22C"]
["22D"]
["22E"]
["22F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Motor Vehicle Record (MVR) Reordering"]
[23,"Does your company use or are you investigating AI/ML for Motor Vehicle Record (MVR) Reordering?"]
["23A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
["23B","List each AI/ML model used for Motor Vehicle Record (MVR) Reordering (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[24,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["24A"]
["24B"]
["24C"]
["24D"]
["24E"]
["24J","If more than 5 AI/ML models are used, please list them here:"]
[]
[]
[null,"Other Underwriting-Related Functions"]
[25,"Does your company use or are you investigating AI/ML for Other Underwriting-Related Functions?"]
["25A","If yes, list the other functions:"]
["25B","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[26,"List each AI/ML model used for Other Underwriting-Related Functions (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["26A"]
["26B"]
["26C"]
["26D"]
["26E"]
["26F","If more than 5 AI/ML models are used, list them here:"]
[]
[]
[]
[]
[null,"UNDERWRITING DATA USE"]
[null,"Data Element Type:","Internal","External","Both"]
[]
[100,"Does your company use the following data element type WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense) , Select all element types your company uses WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense)"]
["100A","If \"Other: Non-Traditional Data Elements\" was selected in Question 100, list those other data elements:"]
[101,"If External OR Both in Question 100, list each data vendor:"]
["101A"]
["101B"]
["101C"]
["101D"]
["101E"]
["101F","If more than 5 AI/ML UNDERWRITING data vendors are used for the respective data element type, please list additional vendors here: "]
[102,"Does the AI/ML System use as an input any type of Consumer or Other \"Score\" calculated with the data element as a component of the score calculation? "]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[null,"Data Element Type:","Consumer or Other Type of \"Score\"","Criminal Convictions (Exclude Auto-Related Convictions)","Insured Demographic Data (Age, Marital, Status, Size of Family)","Geodemographic Data (Non-insurance statistics by ZIP code, census block, etc.)","Education","Facial Detection/ Recognition/ Analysis","Geocoding","Topography (Land Slope, Elevation, etc.)","Historical Weather Information (Temperature, precipitation, etc.)","Hurricane Model Output (AAL, PML, etc.)","Excess Wind/Hail Model Output (AAL, PML, etc.)","Flood Model Output (AAL, PML, etc.)","Earthquake Model Output (AAL, PML, etc.)","Wildfire Wind/Hail Model Output (AAL, PML, etc.)","Job Stability","Income","Occupation","Personal Financial Information","Insured Claim Experience--Home","Insured Claim Experience--Auto","Industry Territorial Loss Statistics","Territorial Crime Rates","Territorial Tax Rates","Medical","Online Media","Smart Home Devices","Security Systems","Roof Data","Defect Identification in Images (Inherent Risk in the Property)","Hazard Detection in Images (risk due to surrounding area)","Potential Loss Estimates in Images (when writing the policy)","Claims Estimates in Images (when setting reserves or adjusting a claim)           ","Other: Non-Traditional Data Elements (Please provide examples)"]
[103,"Does your company use the following data element type WITHIN REGRESSION, STATIC, OR PRE-2000 MODELS? (Respond Yes or No to each Data Element Type.)",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A"]
[104,"If yes for question 103, estimate the number of these types of models utilizing the data element. ",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A"]

{"sheet":"Claims","index":5,"n_rows":216,"n_cols":35,"rows_kept":216,"cut":false,"hidden":false,"merged":[[1,4,4,7],[108,5,109,5],[125,5,126,5],[53,1,53,4],[70,1,70,4],[6,7,21,11],[6,5,7,5],[23,5,24,5],[40,5,41,5],[57,5,58,5],[104,1,104,4],[190,1,190,4],[74,1,74,4],[212,0,212,8],[177,0,178,0],[142,0,143,0],[142,1,142,4],[159,0,160,0],[159,1,159,4],[177,1,177,4],[198,1,198,4],[159,5,160,5],[177,5,178,5],[209,1,209,2],[142,5,143,5],[74,5,75,5],[91,5,92,5],[0,0,0,8],[125,0,126,0],[125,1,125,4],[6,0,7,0],[6,1,6,4],[23,0,24,0],[23,1,23,4],[40,0,41,0],[40,1,40,4],[87,1,87,4],[57,1,57,4],[108,0,109,0],[108,1,108,4],[74,0,75,0],[91,0,92,0],[91,1,91,4]]}
["AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
["Not found","CLAIMS MODELS",null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
[]
[null,"Claim Approval"]
[1,"Does your company use or are you investigating AI/ML for Claim Approval?"]
["1A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[2,"List each AI/ML model used for Claim Approval (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply",null,"The AI/ML Model Category Types are shown below. Detailed definitions can be found within the HO AI/ML Definitions:\n•\tDL –   Deep Learning\n•\tENS –   Ensemble\n•\tNN –   Neural Network\n•\tREG –   Regularization\n•\tRS –   Rule System\n•\tRGS – Regression  \n•\tBAY –   Bayesian Methods\n•\tDT –   Decision Trees \n•\tDR –   Dimensionality Reduction\n•\tIB –   Instance-Based \n•\tCLU –   Clustering \n•\tAI – AI that is not categorized as ML\n• AML - Automated Machine Learning\n•\tOther – Any Other"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["2A"]
["2B"]
["2C"]
["2D"]
["2E"]
["2F"]
["2G"]
["2H"]
["2I"]
["2J"]
["2K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Claim Denial"]
[3,"Does your company use or are you investigating AI/ML for Claim Denial?"]
["3A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[4,"List each AI/ML model used for Claim Denial (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["4A"]
["4B"]
["4C"]
["4D"]
["4E"]
["4F"]
["4G"]
["4H"]
["4I"]
["4J"]
["4K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Determine Settlement Amount"]
[5,"Does your company use or are you investigating AI/ML to Determine Settlement Amount?"]
["5A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[6,"List each AI/ML model used for Determine Settlement Amount (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["6A"]
["6B"]
["6C"]
["6D"]
["6E"]
["6F"]
["6G"]
["6H"]
["6I"]
["6J"]
["6K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Claim Assignment Decisions"]
[7,"Does your company use or are you investigating AI/ML for Claim Assignment Decisions?"]
["7A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[8,"List each AI/ML model used for Claim Assignment Decisions (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["8A"]
["8B"]
["8C"]
["8D"]
["8E"]
["8F"]
["8G"]
["8H"]
["8I"]
["8J"]
["8K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Informational Resource for Adjusters"]
[9,"Does your company use or are you investigating AI/ML as an Informational Resource for Adjusters?"]
["9A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[10,"List each AI/ML model used as an Informational Resource for Adjusters (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["10A"]
["10B"]
["10C"]
["10D"]
["10E"]
["10F"]
["10G"]
["10H"]
["10I"]
["10J"]
["10K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Evaluation of Images of the Loss"]
[11,"Does your company use or are you investigating AI/ML for Evaluation of Images of the Loss?"]
["11A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[12,"List each AI/ML model used for Evaluation of Images of the Loss (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["12A"]
["12B"]
["12C"]
["12D"]
["12E"]
["12F"]
["12G"]
["12H"]
["12I"]
["12J"]
["12K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Subrogation"]
[13,"Does your company use or are you investigating AI/ML for Subrogation?"]
["13A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[14,"List each AI/ML model used for Subrogation (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["14A"]
["14B"]
["14C"]
["14D"]
["14E"]
["14F"]
["14G"]
["14H"]
["14I"]
["14J"]
["14K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Claims Triage"]
[15,"Does your company use or are you investigating AI/ML for Claims Triage?"]
["15A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[16,"List each AI/ML model used for Claims Triage (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["16A"]
["16B"]
["16C"]
["16D"]
["16E"]
["16F"]
["16G"]
["16H"]
["16I"]
["16J"]
["16K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Speech Analysis"]
[17,"Does your company use or are you investigating AI/ML for Speech Analysis?"]
["17A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[18,"List each AI/ML model used for Speech Analysis (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["18A"]
["18B"]
["18C"]
["18D"]
["18E"]
["18F"]
["18G"]
["18H"]
["18I"]
["18J"]
["18K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Litigation Likelihood"]
[19,"Does your company use or are you investigating AI/ML for Litigation Likelihood?"]
["19A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[20,"List each AI/ML model used for Litigation Likelihood (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["20A"]
["20B"]
["20C"]
["20D"]
["20E"]
["20F"]
["20G"]
["20H"]
["20I"]
["20J"]
["20K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Other Claim-Related Functions"]
[21,"Does your company use or are you investigating AI/ML for Other Claim-Related Functions?"]
["21A","If yes, list the other functions:"]
["21B","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[22,"List each AI/ML model used for Other Claim-Related Functions (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["22A"]
["22B"]
["22C"]
["22D"]
["22E"]
["22F"]
["22G"]
["22H"]
["22I"]
["22J"]
["22K","If more than 10 AI/ML models are used, please list them here:"]
[]
[]
[]
[null,"CLAIM DATA USE"]
[]
[null,"Data Element Type:","Internal","External","Both"]
[100,"Does your company use the following data element type WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense) , Select all element types your company uses WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense)"]
["100A","If \"Other: Non-Traditional Data Elements\" was selected in Question 100, list those other data elements:"]
[101,"If External OR Both in Question 100, list each data vendor:"]
["101A"]
["101B"]
["101C"]
["101D"]
["101E"]
["101F"]
["101G"]
["101H"]
["101I"]
["101J"]
["101K","If more than 10 AI/ML CLAIMS data vendors are used for the respective data element type, please list additional vendors here: "]
[102,"Does the AI/ML System use as an input any type of Consumer or Other \"Score\" calculated with the data element as a component of the score calculation? "]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[null,"Data Element Type:","Consumer or Other Type of \"Score\"","Criminal Convictions (Exclude Auto-Related Convictions)","Insured Demographic Data (Age, Marital, Status, Size of Family)","Geodemographic Data (Non-insurance statistics by ZIP code, census block, etc.)","Education","Facial Detection/ Recognition/ Analysis","Geocoding","Topography (Land Slope, Elevation, etc.)","Historical Weather Information (Temperature, precipitation, etc.)","Hurricane Model Output (AAL, PML, etc.)","Excess Wind/Hail Model Output (AAL, PML, etc.)","Flood Model Output (AAL, PML, etc.)","Earthquake Model Output (AAL, PML, etc.)","Wildfire Wind/Hail Model Output (AAL, PML, etc.)","Job Stability","Income","Occupation","Personal Financial Information","Insured Claim Experience--Home","Insured Claim Experience--Auto","Industry Territorial Loss Statistics","Territorial Crime Rates","Territorial Tax Rates","Medical","Online Media","Smart Home Devices","Security Systems","Roof Data","Defect Identification in Images (Inherent Risk in the Property)","Hazard Detection in Images (risk due to surrounding area)","Potential Loss Estimates in Images (when writing the policy)","Claims Estimates in Images (when setting reserves or adjusting a claim)           ","Other: Non-Traditional Data Elements (Please provide examples)"]
[103,"Does your company use the following data element type WITHIN REGRESSION, STATIC, OR PRE-2000 MODELS? (Respond Yes or No to each Data Element Type.)",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A"]
[104,"If yes for question 103, estimate the number of these types of models utilizing the data element. ",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A"]

{"sheet":"Fraud Detection","index":6,"n_rows":216,"n_cols":35,"rows_kept":216,"cut":false,"hidden":false,"merged":[[125,5,126,5],[142,5,143,5],[159,5,160,5],[177,5,178,5],[53,1,53,4],[57,1,57,4],[91,1,91,4],[108,1,108,4],[91,5,92,5],[108,5,109,5],[125,1,125,4],[142,1,142,4],[209,1,209,2],[159,1,159,4],[212,0,212,8],[190,1,190,4],[177,0,178,0],[177,1,177,4],[198,1,198,4],[0,1,0,9],[6,1,6,4],[74,1,74,4],[87,1,87,4],[6,7,21,11],[6,5,7,5],[23,5,24,5],[40,5,41,5],[57,5,58,5],[74,5,75,5],[70,1,70,4],[1,4,4,7],[74,0,75,0],[159,0,160,0],[91,0,92,0],[108,0,109,0],[125,0,126,0],[142,0,143,0],[6,0,7,0],[23,0,24,0],[23,1,23,4],[40,0,41,0],[40,1,40,4]]}
[null,"AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
["Not found","FRAUD DETECTION MODELS",null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
[]
[null,"Fast-Tracking of Likely Non-Fraudulent Claims"]
[1,"Does your company use or are you investigating AI/ML for Fast-Tracking of Likely Non-Fraudulent Claims?"]
["1A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[2,"List each AI/ML model used for Fast-Tracking of Likely Non-Fraudulent Claims (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply",null,"The AI/ML Model Category Types are shown below. Detailed definitions can be found within the HO AI/ML Definitions:\n•\tDL –   Deep Learning\n•\tENS –   Ensemble\n•\tNN –   Neural Network\n•\tREG –   Regularization\n•\tRS –   Rule System\n•\tRGS – Regression  \n•\tBAY –   Bayesian Methods\n•\tDT –   Decision Trees \n•\tDR –   Dimensionality Reduction\n•\tIB –   Instance-Based \n•\tCLU –   Clustering \n•\tAI – AI that is not categorized as ML\n• AML - Automated Machine Learning\n•\tOther – Any Other"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["2A"]
["2B"]
["2C"]
["2D"]
["2E"]
["2F"]
["2G"]
["2H"]
["2I"]
["2J"]
["2K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Referral of Claims for Further Investigation"]
[3,"Does your company use or are you investigating AI/ML for Referral of Claims for Further Investigation?"]
["3A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[4,"List each AI/ML model used for Referral of Claims for Further Investigation (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["4A"]
["4B"]
["4C"]
["4D"]
["4E"]
["4F"]
["4G"]
["4H"]
["4I"]
["4J"]
["4K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Detect Medical Provider Fraud"]
[5,"Does your company use or are you investigating AI/ML to Detect Medical Provider Fraud?"]
["5A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[6,"List each AI/ML model used to Detect Medical Provider Fraud (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["6A"]
["6B"]
["6C"]
["6D"]
["6E"]
["6F"]
["6G"]
["6H"]
["6I"]
["6J"]
["6K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Detect First-Party Liability"]
[7,"Does your company use or are you investigating AI/ML to Detect First-Party Liability?"]
["7A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[8,"List each AI/ML model used to Detect First-Party Liability (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["8A"]
["8B"]
["8C"]
["8D"]
["8E"]
["8F"]
["8G"]
["8H"]
["8I"]
["8J"]
["8K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Detect Third-Party Liability"]
[9,"Does your company use or are you investigating AI/ML to Detect Third-Party Liability?"]
["9A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[10,"List each AI/ML model used to Detect Third-Party Liability (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["10A"]
["10B"]
["10C"]
["10D"]
["10E"]
["10F"]
["10G"]
["10H"]
["10I"]
["10J"]
["10K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Fraudulent Quote Detection"]
[11,"Does your company use or are you investigating AI/ML for Fraudulent Quote Detection?"]
["11A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[12,"List each AI/ML model used for Fraudulent Quote Detection (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["12A"]
["12B"]
["12C"]
["12D"]
["12E"]
["12F"]
["12G"]
["12H"]
["12I"]
["12J"]
["12K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Organized Crime Rings Identification"]
[13,"Does your company use or are you investigating AI/ML for Organized Crime Rings Identification?"]
["13A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[14,"List each AI/ML model used for Organized Crime Rings Identification (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["14A"]
["14B"]
["14C"]
["14D"]
["14E"]
["14F"]
["14G"]
["14H"]
["14I"]
["14J"]
["14K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Social Network Analysis"]
[15,"Does your company use or are you investigating AI/ML for Social Network Analysis?"]
["15A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[16,"List each AI/ML model used for Social Network Analysis (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["16A"]
["16B"]
["16C"]
["16D"]
["16E"]
["16F"]
["16G"]
["16H"]
["16I"]
["16J"]
["16K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Facial Recognition & Behavior Models"]
[17,"Does your company use or are you investigating AI/ML for Facial Recognition & Behavior Models?"]
["17A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[18,"List each AI/ML model used for Facial Recognition & Behavior Models (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["18A"]
["18B"]
["18C"]
["18D"]
["18E"]
["18F"]
["18G"]
["18H"]
["18I"]
["18J"]
["18K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Evaluation of Potential for Intentional Infliction of Damage"]
[19,"Does your company use or are you investigating AI/ML for Evaluation of Potential for Intentional Infliction of Damage?"]
["19A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[20,"List each AI/ML model used for Evaluation of Potential for Intentional Infliction of Damage (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["20A"]
["20B"]
["20C"]
["20D"]
["20E"]
["20F"]
["20G"]
["20H"]
["20I"]
["20J"]
["20K","If more than 10 AI/ML models are used, please list them here:"]
[]
[null,"Other Fraud Detection-Related Functions"]
[21,"Does your company use or are you investigating AI/ML for Other Fraud Detection-Related Functions?"]
["21A","If yes, list the other functions:"]
["21B","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[22,"List each AI/ML model used for Other Fraud Detection-Related Functions (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["22A"]
["22B"]
["22C"]
["22D"]
["22E"]
["22F"]
["22G"]
["22H"]
["22I"]
["22J"]
["22K","If more than 10 AI/ML models are used, please list them here:"]
[]
[]
[]
[null,"FRAUD DETECTION DATA USE"]
[]
[null,"Data Element Type:","Internal","External","Both"]
[100,"Does your company use the following data element type WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense) , Select all element types your company uses WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense)"]
["100A","If \"Other: Non-Traditional Data Elements\" was selected in Question 100, list those other data elements:"]
[101,"If External OR Both in Question 100, list each data vendor:"]
["101A"]
["101B"]
["101C"]
["101D"]
["101E"]
["101F"]
["101G"]
["101H"]
["101I"]
["101J"]
["101K","If more than 10 AI/ML FRAUD DETECTION data vendors are used for the respective data element type, please list additional vendors here: "]
[102,"Does the AI/ML System use as an input any type of Consumer or Other \"Score\" calculated with the data element as a component of the score calculation? "]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[null,"Data Element Type:","Consumer or Other Type of \"Score\"","Criminal Convictions (Exclude Auto-Related Convictions)","Insured Demographic Data (Age, Marital, Status, Size of Family)","Geodemographic Data (Non-insurance statistics by ZIP code, census block, etc.)","Education","Facial Detection/ Recognition/ Analysis","Geocoding","Topography (Land Slope, Elevation, etc.)","Historical Weather Information (Temperature, precipitation, etc.)","Hurricane Model Output (AAL, PML, etc.)","Excess Wind/Hail Model Output (AAL, PML, etc.)","Flood Model Output (AAL, PML, etc.)","Earthquake Model Output (AAL, PML, etc.)","Wildfire Wind/Hail Model Output (AAL, PML, etc.)","Job Stability","Income","Occupation","Personal Financial Information","Insured Claim Experience--Home","Insured Claim Experience--Auto","Industry Territorial Loss Statistics","Territorial Crime Rates","Territorial Tax Rates","Medical","Online Media","Smart Home Devices","Security Systems","Roof Data","Defect Identification in Images (Inherent Risk in the Property)","Hazard Detection in Images (risk due to surrounding area)","Potential Loss Estimates in Images (when writing the policy)","Claims Estimates in Images (when setting reserves or adjusting a claim)           ","Other: Non-Traditional Data Elements (Please provide examples)"]
[103,"Does your company use the following data element type WITHIN REGRESSION, STATIC, OR PRE-2000 MODELS? (Respond Yes or No to each Data Element Type.)",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A","N/A"]
[104,"If yes for question 103, estimate the number of these types of models utilizing the data element. ",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A","N/A","List examples here"]

{"sheet":"Marketing","index":7,"n_rows":156,"n_cols":35,"rows_kept":156,"cut":false,"hidden":false,"merged":[[78,5,79,5],[90,5,91,5],[152,0,152,8],[127,0,128,0],[127,1,127,4],[135,1,135,4],[143,1,143,4],[102,5,103,5],[114,5,115,5],[127,5,128,5],[149,1,149,2],[0,1,0,9],[50,1,50,4],[62,1,62,4],[54,1,54,4],[66,1,66,4],[42,1,42,4],[38,1,38,4],[6,5,7,5],[18,5,19,5],[30,5,31,5],[42,5,43,5],[54,5,55,5],[66,5,67,5],[6,7,21,11],[1,4,4,7],[6,0,7,0],[6,1,6,4],[18,1,18,4],[18,0,19,0],[30,0,31,0],[30,1,30,4],[54,0,55,0],[66,0,67,0],[114,0,115,0],[114,1,114,4],[78,0,79,0],[78,1,78,4],[90,0,91,0],[90,1,90,4],[102,0,103,0],[102,1,102,4],[74,1,74,4]]}
[null,"AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
["Not found","MARKETING MODELS",null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
[]
[null,"Targeted Online Advertising"]
[1,"Does your company use or are you investigating AI/ML for Targeted Online Advertising?"]
["1A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[2,"List each AI/ML model used for Targeted Online Advertising (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply",null,"The AI/ML Model Category Types are shown below. Detailed definitions can be found within the HO AI/ML Definitions:\n•\tDL –   Deep Learning\n•\tENS –   Ensemble\n•\tNN –   Neural Network\n•\tREG –   Regularization\n•\tRS –   Rule System\n•\tRGS – Regression  \n•\tBAY –   Bayesian Methods\n•\tDT –   Decision Trees \n•\tDR –   Dimensionality Reduction\n•\tIB –   Instance-Based \n•\tCLU –   Clustering \n•\tAI – AI that is not categorized as ML\n• AML - Automated Machine Learning\n•\tOther – Any Other"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["2A"]
["2B"]
["2C"]
["2D"]
["2E"]
["2F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Identification of Recipients of Mail or Phone Advertising"]
[3,"Does your company use or are you investigating AI/ML for Identification of Recipients of Mail or Phone Advertising?"]
["3A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[4,"List each AI/ML model used for Identification of Recipients of Mail or Phone Advertising (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["4A"]
["4B"]
["4C"]
["4D"]
["4E"]
["4F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Provision of Offers to Existing Customers"]
[5,"Does your company use or are you investigating AI/ML for Provision of Offers to Existing Customers?"]
["5A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[6,"List each AI/ML model used for Provision of Offers to Existing Customers (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["6A"]
["6B"]
["6C"]
["6D"]
["6E"]
["6F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Identification of Potential Customer Groups"]
[7,"Does your company use or are you investigating AI/ML for Identification of Potential Customer Groups?"]
["7A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[8,"List each AI/ML model used for Identification of Potential Customer Groups (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["8A"]
["8B"]
["8C"]
["8D"]
["8E"]
["8F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Demand Modeling"]
[9,"Does your company use or are you investigating AI/ML for Demand Modeling?"]
["9A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[10,"List each AI/ML model used for Demand Modeling (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["10A"]
["10B"]
["10C"]
["10D"]
["10E"]
["10F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Direct Online Sales"]
[11,"Does your company use or are you investigating AI/ML for Direct Online Sales?"]
["11A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[12,"List each AI/ML model used for Direct Online Sales (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["12A"]
["12B"]
["12C"]
["12D"]
["12E"]
["12F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Customer Interactions using NLP"]
[13,"Does your company use or are you investigating AI/ML for Customer Interactions using NLP?"]
["13A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[14,"List each AI/ML model used for Customer Interactions using NLP (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["14A"]
["14B"]
["14C"]
["14D"]
["14E"]
["14F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Media Mix Modeling"]
[15,"Does your company use or are you investigating AI/ML for Media Mix Modeling?"]
["15A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[16,"List each AI/ML model used for Media Mix Modeling (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["16A"]
["16B"]
["16C"]
["16D"]
["16E"]
["16F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Customer Acquistion and Retention "]
[17,"Does your company use or are you investigating AI/ML for Customer Acquistion and Retention?"]
["17A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[18,"List each AI/ML model used for Customer Acquistion and Retention (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["18A"]
["18B"]
["18C"]
["18D"]
["18E"]
["18F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Click Analysis on 3rd-Party Sites"]
[19,"Does your company use or are you investigating AI/ML for Click Analysis on 3rd-Party Sites?"]
["19A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[20,"List each AI/ML model used for Click Analysis on 3rd-Party Sites (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["20A"]
["20B"]
["20C"]
["20D"]
["20E"]
["20F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Other Marketing-Related Functions"]
[21,"Does your company use or are you investigating AI/ML for Other Marketing-Related Functions?"]
["21A","If yes, list the other functions:"]
["21B","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[22,"List each AI/ML model used for Other Marketing-Related Functions (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["22A"]
["22B"]
["22C"]
["22D"]
["22E"]
["22F","If more than 5 AI/ML models are used, please list them here:"]
[]
[]
[]
[null,"MARKETING DATA USE"]
[]
[null,"Data Element Type:","Internal","External","Both"]
[100,"Does your company use the following data element type WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense) , Select all element types your company uses WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense)"]
["100A","If \"Other: Non-Traditional Data Elements\" was selected in Question 100, list those other data elements:"]
[101,"If External OR Both in above question, list each data vendor:"]
["101A"]
["101B"]
["101C"]
["101D"]
["101E"]
["101F","If more than 5 AI/ML MARFETING data vendors are used for the respective data element type, please list additional vendors here: "]
[102,"Does the AI/ML System use as an input any type of Consumer or Other \"Score\" calculated with the data element as a component of the score calculation?"]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[null,"Data Element Type:","Consumer or Other Type of \"Score\"","Criminal Convictions (Exclude Auto-Related Convictions)","Insured Demographic Data (Age, Marital, Status, Size of Family)","Geodemographic Data (Non-insurance statistics by ZIP code, census block, etc.)","Education","Facial Detection/ Recognition/ Analysis","Geocoding","Topography (Land Slope, Elevation, etc.)","Historical Weather Information (Temperature, precipitation, etc.)","Hurricane Model Output (AAL, PML, etc.)","Excess Wind/Hail Model Output (AAL, PML, etc.)","Flood Model Output (AAL, PML, etc.)","Earthquake Model Output (AAL, PML, etc.)","Wildfire Wind/Hail Model Output (AAL, PML, etc.)","Job Stability","Income","Occupation","Personal Financial Information","Insured Claim Experience--Home","Insured Claim Experience--Auto","Industry Territorial Loss Statistics","Territorial Crime Rates","Territorial Tax Rates","Medical","Online Media","Smart Home Devices","Security Systems","Roof Data","Defect Identification in Images (Inherent Risk in the Property)","Hazard Detection in Images (risk due to surrounding area)","Potential Loss Estimates in Images (when writing the policy)","Claims Estimates in Images (when setting reserves or adjusting a claim)           ","Other: Non-Traditional Data Elements (Please provide examples)"]
[103,"Does your company use the following data element type WITHIN REGRESSION, STATIC, OR PRE-2000 MODELS? (Respond Yes or No to each Data Element Type.)",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A","N/A"]
[104,"If yes for question 103, estimate the number of these types of models utilizing the data element. ",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A","N/A","List examples here"]

{"sheet":"Loss Prevention","index":8,"n_rows":83,"n_cols":35,"rows_kept":83,"cut":false,"hidden":false,"merged":[[79,0,79,8],[55,0,56,0],[38,1,38,4],[0,0,0,8],[6,0,7,0],[14,1,14,4],[26,1,26,4],[6,1,6,4],[18,1,18,4],[18,0,19,0],[42,1,42,4],[63,1,63,4],[30,1,30,4],[55,1,55,4],[70,1,70,4],[1,4,4,7],[6,7,21,11],[76,1,76,2],[6,5,7,5],[18,5,19,5],[30,5,31,5],[42,5,43,5],[55,5,56,5]]}
["AI/ML (as defined for the survey -- Remember to exclude regression, static, and pre-2000 models as defined.)"]
["Not found","LOSS PREVENTION MODELS",null,null,"PLEASE NOTE: \nMany of the entry points contain multiple-selection drop down list boxes. For these boxes,\nif you make a mistake in the selections, you must delete ALL of the entered selections in the cell and then start over."]
[]
[null,"Identification of High-Risk Customers"]
[1,"Does your company use or are you investigating AI/ML for Identification of High-Risk Customers?"]
["1A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[2,"List each AI/ML model used for Identification of High-Risk Customers (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply",null,"The AI/ML Model Category Types are shown below. Detailed definitions can be found within the HO AI/ML Definitions:\n•\tDL –   Deep Learning\n•\tENS –   Ensemble\n•\tNN –   Neural Network\n•\tREG –   Regularization\n•\tRS –   Rule System\n•\tRGS – Regression  \n•\tBAY –   Bayesian Methods\n•\tDT –   Decision Trees \n•\tDR –   Dimensionality Reduction\n•\tIB –   Instance-Based \n•\tCLU –   Clustering \n•\tAI – AI that is not categorized as ML\n• AML - Automated Machine Learning\n•\tOther – Any Other"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["2A"]
["2B"]
["2C"]
["2D"]
["2E"]
["2F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Risk-Mitigation Advice to Consumers"]
[3,"Does your company use or are you investigating AI/ML for Risk-Mitigation Advice to Consumers?"]
["3A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[4,"List each AI/ML model used for Risk-Mitigation Advice to Consumers (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["4A"]
["4B"]
["4C"]
["4D"]
["4E"]
["4F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Determination of Advance Payments"]
[5,"Does your company use or are you investigating AI/ML for Determination of Advance Payments?"]
["5A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[6,"List each AI/ML model used for Determination of Advance Payments (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["6A"]
["6B"]
["6C"]
["6D"]
["6E"]
["6F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Guidance for Loss Control Inspections"]
[7,"Does your company use or are you investigating AI/ML for Guidance for Loss Control Inspections?"]
["7A","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[8,"List each AI/ML model used for Guidance for Loss Control Inspections (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["8A"]
["8B"]
["8C"]
["8D"]
["8E"]
["8F","If more than 5 AI/ML models are used, please list them here:"]
[]
[null,"Other Loss Prevention-Related Functions"]
[9,"Does your company use or are you investigating AI/ML for Other Loss Prevention-Related Functions?"]
["9A","If yes, list the other functions:"]
["9B","If yes, what is the current level of AI/ML Deployment? (Select the highest level of deployment)"]
[10,"List each AI/ML model used for Other Loss Prevention-Related Functions (AI/ML models only, not all GLMs), developed internally or by a third-party, and whether model governance is in place.",null,null,null,"AI/ML Model Category Types \nSelect All That Apply"]
[null,"AI/ML Model Name","Developed Internally or by a Third-party","If Developed by a Third-party, then list the Third-party","Indicate the Level of Decisions Influenced by AI/ML (anticipated or already implemented)"]
["10A"]
["10B"]
["10C"]
["10D"]
["10E"]
["10F","If more than 5 AI/ML models are used, please list them here:"]
[]
[]
[null,"LOSS PREVENTION DATA USE"]
[]
[null,"Data Element Type:","Internal","External","Both"]
[100,"Does your company use the following data element type WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense) , Select all element types your company uses WITHIN AN AI/ML SYSTEM (specific to AI/ML - not asking if the entity uses these data types generally, in a traditional sense)"]
["100A","If \"Other: Non-Traditional Data Elements\" was selected in Question 100, list those other data elements:"]
[101,"If External OR Both in above question, list each data vendor:"]
["101A"]
["101B"]
["101C"]
["101D"]
["101E"]
["101F","If more than 5 AI/ML LOSS PREVENTION data vendors are used for the respective data element type, please list additional vendors here: "]
[102,"Does the AI/ML System use as an input any type of Consumer or Other \"Score\" calculated with the data element as a component of the score calculation? "]
[]
["For regression, static, or pre-2000 models (These are the models defined to be excluded from the AI/ML definition for this survey.)"]
[null,"Data Element Type:","Consumer or Other Type of \"Score\"","Criminal Convictions (Exclude Auto-Related Convictions)","Insured Demographic Data (Age, Marital, Status, Size of Family)","Geodemographic Data (Non-insurance statistics by ZIP code, census block, etc.)","Education","Facial Detection/ Recognition/ Analysis","Geocoding","Topography (Land Slope, Elevation, etc.)","Historical Weather Information (Temperature, precipitation, etc.)","Hurricane Model Output (AAL, PML, etc.)","Excess Wind/Hail Model Output (AAL, PML, etc.)","Flood Model Output (AAL, PML, etc.)","Earthquake Model Output (AAL, PML, etc.)","Wildfire Wind/Hail Model Output (AAL, PML, etc.)","Job Stability","Income","Occupation","Personal Financial Information","Insured Claim Experience--Home","Insured Claim Experience--Auto","Industry Territorial Loss Statistics","Territorial Crime Rates","Territorial Tax Rates","Medical","Online Media","Smart Home Devices","Security Systems","Roof Data","Defect Identification in Images (Inherent Risk in the Property)","Hazard Detection in Images (risk due to surrounding area)","Potential Loss Estimates in Images (when writing the policy)","Claims Estimates in Images (when setting reserves or adjusting a claim)           ","Other: Non-Traditional Data Elements (Please provide examples)"]
[103,"Does your company use the following data element type WITHIN REGRESSION, STATIC, OR PRE-2000 MODELS? (Respond Yes or No to each Data Element Type.)",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A","N/A"]
[104,"If yes for question 103, estimate the number of these types of models utilizing the data element. ",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"N/A","N/A","List examples here"]

{"sheet":"Sheet2","index":9,"n_rows":33,"n_cols":24,"rows_kept":33,"cut":false,"hidden":true,"merged":[[2,4,3,4]]}
["Yes","Research","Automation (No human intervention on execution)","Developed Internally","Yes","Rating","N/A","I","Developed Internally",null,"DL",null,"Companywide",null,null,"Companywide",null,"Consumer or Other Type of \"Score\"",null,null,"Developed Internally",null,null,{"$f":"COUNTBLANK(General!C4)+COUNTBLANK(General!C6:F6)+COUNTBLANK(General!B8:C12)+COUNTBLANK(General!C14:J22)-COUNTBLANK(General!D14:J20)+COUNTBLANK(General!C25:J25)","v":38}]
["No","Proof of Concept","Augmentation (Model advises human who makes decision - model suggests answer)","Developed by a third-party","No","Underwriting","Currently Using","E","Provided by a third-party","ank(","ENS",null,"Rating",null,null,"Rating",null,"Criminal Convictions (Exclude Auto-Related Convictions)",null,null,"Provided by a Thrid Party",null,null,{"$f":"COUNTBLANK(Governance!C4)+COUNTBLANK(Governance!C6:C12)+COUNTBLANK(Governance!C14:J19)-COUNTBLANK(Governance!D16:J17)+COUNTBLANK(Governance!C23:J24)","v":58}]
[null,"Prototype","Support (Model provides information but does not suggest decision or action)",null,"Will Be When Implemented","Claims","< 1 Year until Use","B","Hybrid of internally developed and third-party components",null,"NN",null,"Underwriting",null,null,"Underwriting",null,"Insured Demographic Data (Age, Marital, Status, Size of Family)",null,null,"Hybrid"]
[null,"Implemented in Production","Other",null,null,"Fraud Detection","1 - 3 Years until Use",null,null,null,"REG",null,"Claims",null,null,"Claims",null,"Geodemographic Data (Non-insurance statistics by ZIP code, census block, etc.)"]
[null,null,null,null,null,"Marketing","> 3 Years until Use",null,null,null,"RS",null,"Fraud Detection",null,null,"Fraud Detection",null,"Education"]
[null,null,null,null,null,"Loss Prevention",null,null,null,null,"RGS",null,"Marketing",null,null,"Marketing",null,"Facial Detection/ Recognition/ Analysis"]
[null,null,null,null,null,null,null,null,null,null,"BAY",null,"Loss Prevention",null,null,"Loss Prevention",null,"Geocoding"]
[null,null,null,null,null,null,null,null,null,null,"DT",null,"Other",null,null,"Other",null,"Topography (Land Slope, Elevation, etc.)"]
[null,null,null,null,null,null,null,null,null,null,"DR",null,"None of the above",null,null,null,null,"Historical Weather Information (Temperature, precipitation, etc.)"]
[null,null,null,null,null,null,null,null,null,null,"IB",null,null,null,null,null,null,"Hurricane Model Output (AAL, PML, etc.)"]
[null,null,null,null,null,null,null,null,null,null,"CLU",null,null,null,null,null,null,"Excess Wind/Hail Model Output (AAL, PML, etc.)"]
[null,null,null,null,null,null,null,null,null,null,"AI",null,null,null,null,null,null,"Flood Model Output (AAL, PML, etc.)"]
[null,null,null,null,null,null,null,null,null,null,"AML",null,null,null,null,null,null,"Earthquake Model Output (AAL, PML, etc.)"]
[null,null,null,null,null,null,null,null,null,null,"Other - Specify",null,null,null,null,null,null,"Wildfire Wind/Hail Model Output (AAL, PML, etc.)"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Job Stability"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Income"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Occupation"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Personal Financial Information"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Insured Claim Experience--Home"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Insured Claim Experience--Auto"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Industry Territorial Loss Statistics"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Territorial Crime Rates"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Territorial Tax Rates"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Medical"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Online Media"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Smart Home Devices"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Security Systems"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Roof Data"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Defect Identification in Images (Inherent Risk in the Property)"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Hazard Detection in Images (risk due to surrounding area)"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Potential Loss Estimates in Images (when writing the policy)"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Claims Estimates in Images (when setting reserves or adjusting a claim)           "]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Other: Non-Traditional Data Elements (Please provide examples)"]